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SECTION 1: PROJECT OVERVIEW 



This report provides additional information, collected as part of the International Assessment of 
Educational Progress II (lAEP U), about learning in Alberta. It includes information on the 
educational and cultural factors associated with student achievement, as well as information on 
student attitudes, backgrounds, and experiences. Results for all participating countries are 
presented in two lAEP reports: Learning Mathematics and Learning Science. Copies of these 
reports have been distributed to all school superintendents and to the schools that participated in the 
study. 

This report identifies what Alberta's 13-year-olds were able to achieve. As well, Alberta results 
are reported in relation to other Canadian provinces and to some interesting international 
comparisons. Appendices 1 and 2 sunamarize test administration procedures. 



Overview of lAEP II 

In 1990-91, a total of 20 countries, including nine Canadian provinces, surveyed the mathematics 
and science performance of their 13-year-old students. An optional short probe of geography 
achievement and an experimental mathematics and science performance-based assessment of 13- 
year-olds were also administered by some participants. Finally, 14 countries selected the 
additional option to assess 9- year-olds in the same subjects. 



Participants (all Canadian provinces except Prince Edward Island participated): 



Brazil 


Mozambique 


Canada: Alberta 


China 


Portugal 


British Columbia 


England 


Scotland 


Manitoba 


France 


Slovenia 


New Brunswick 


Hungary 


Soviet Union 


Newfoundland 


Ireland 


Spain 


Nova Scotia 


Israel 


Switzerland 


Ontario 


Italy 


Taiwan 


Quebec 


Jordan 


United States 


Saskatchewan 


Korea 







All participants conducted the mathematics and science assessment of 13-year-olds — the main part 
of the project. Nine countries, including Alberta and seven other Canadian provinces, participated 
in the optional assessment of geography at the 13-year-old level. 

•As an additional component of the study, 14 countries including four Canadian provinces 
participated in the optional assessment of mathentiatics and science at the 9-year-old level: 
England, Hungary, Ireland, Israel, Italy, Korea, Portugal, Slovenia, Scotiand, Spain, 
Soviet Union, Taiwan, the United States, and British Columbia, New Brunswick, 
Ontario, and Quebec. 

•Four countries (Taiwan, Scotiand, England, Soviet Union) and five provinces (Alberta, 
Ontario, Saskatchewan, British Columbia, Nova Scotia) participated in the performance 
task (hands-on) assessment of 13- year-olds. The performance assessment report, which 
will include Alberta's results, is forthcoming. 

Each country or province that participated did so for its own reasons. In Alberta, the study 
provided an opportunity to gauge what our students are able to demonstrate they can do in relation 
to the skills and knowledge demonstrated by students in other places around the world. This 
information permits reflection on the expectations described in Alberta's programs of studies as we 
examine the standards that they communicate. 



Highlights of Alberta's Participation 

In Alberta, 119 randomly selected schools, participated in the project. Students tliat were 13 years 
old were randomly sampled from these schools to write either the mathematics or the science test 
booklet. 

♦1422 Alberta students completed the mathematics booklet, plus 12 geography questions. 
♦1459 Alberta students completed the science booklet, plus 12 geography questions. 

The geography component consisted of 24 questions; 12 were placed along with the mathematics 
booklet and 12 with the science booklet. 

Alberta's Performance 

Science (13-year-olds): 

Alberta did very well. Not only did Alberta students score in the top one-third ui all 
comparisons, they ranked first in Canada and third internationally. 

Mathematics (13-year-olds): 

Alberta did not perform as well in mathematics. Results are in the middle third when compared 
nationaUy and internationally. In particular. Alberta's scores in Geometry, and Algebra and 
Functions were the lowest (middle or bottom third in comparisons); scores for Numbers and 
Operations, Measurement, and Data Analysis and Statistics were higher (mostiy in die top third of 
all scores). ^ 

Geography (13-year-olds): 

Resuhs show Alberta students in the top third in all comparisons. Results are very good 
considering there is not a specific geography curriculum in Alberta. Geography knowledge and 
skills are integrated mostiy into social studies and science. 

♦Caution: The geography component had only 24 questions and was conducted to collect only a 
minimum of information on geography skills. It should not be interpreted as an extensive 
assessment of geography knowledge and skills. 



"Context for Learning*' Highlights 

Data that describe the different contexts for learning can contribute to an understanding of 
achievement results. Of particular interest are patterns that might emerge in relation to high student 
performance or low student performance. The LAEP II study collected information from students 
and school principals about some of the characteristics of educational systems, classrooms, homes, 
and students that might contribute to the the ightful interpretation of achievement results. 
Throughout this report, detailed information is presented about the learning contexts for Alberta, 
for other Canadian provinces, and for some countries with interesting comparisons. This 
information provides insights that are helpful in understanding the impact of educational and 
cultural factors on student achievement and learning. A few highlights are listed below. 
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Amount of Instruction and Class Size 

Generally, tlie highest performing countries also have the most instructional days in their school 
year. Taiwan, Korea, and Switzerland follow this pattern. 

In this study, student achievement does not appear to be related closely to class size. Of particular 
note are Korea and Taiwan, both of which have very large class sizes and high performance 
scores. 

Home Characteristics 

Scienc'^ '*nd mathematics performance in lAEP II was directly related to the number of books in 
stuc* nomes. Students with access to a larger number of books achieved higher scores. This 
iscf r jstent for all countries and provinces that participated 

There seems to be a difference between North America and other countries in the impact on scores 
when parents show an interest in science. In North America, students score higher when parents 
show an interest in science. This is not necessarily the case in other parts of the world. Why this 
difference exists can only be hypothesized, taking into consideration the cultural differences that 
exist between countries. 

How Students Spend Their Time 

Children who read more do better; those who watch more television do not do as well. These 
findings were consistent for both science and mathematics. However, a clear pattern for student 
performance in relation to the amount of time students spend on homework did not emerge. It is 
interestmg to note that North American results show either no impact or a negative influence on 
results as students spend more time on all homework. In other countries, there is either no impact 
or a positive one. ITiis suggests there may be a qualitative difference in the type of homework 
North American children do compared with children in other countries. 

Student Attitudes 

In nearly every country or province, students with positive attitudes toward mathematics and 
science do better than those who are less positive. While this is not surprising, the importance of a 
positive attitude is reinforced as a key contributor to higher results. 

Calculators and Computers 

Students in Canada and the United States have or have access to calculators and computers more so 
than students in most other countries. But, the study shows that this advantage has not generally 
resulted in North American students achieving higher scores. 
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SECTION 2: COUNTRIES AND THEIR EDUCATION SYSTEMS 



Information about schools and schooling in participating countries follows. The v/ay in which 
education systems deliver programs varies widely, as does the cultural context withm which the 
programs operate. 

Figures 2.1 and 2.2 provide data on class size, amount of instmction and other categories for 
which information was collected in relation to achievement 



Figure 2.1. Education Systems and Average Percent Correct 




Average % 
Correct in 
Science 


Average % 
Correct in 
Math 


Average Days 
of Instruction 
in Year* 


Avg. Minutes 
of Instruction 
in School 
Each Day* 


Average 
Class Size for 
Grade 8* 


% 01 schools 
Witli One or 
More Serious 
Problems** 


Science 

Rank Order/IAEP Average 


67 


58 










Korea 


78 


73 


222 


264 


49 


24 


Taiwan 


76 


73 


222 


318 


44 


10 


Switzerland 


74 


71 


207 


305 


18 


11 


Hungary 


73 


68 


177 


223 


27 


32 


Soviet Union 


71 


70 


198 


243 


22 


72 


Slovenia 


70 


57 


190 


248 


25 


50 


Emilia-RomaKna, Italy 


70 


64 


204 


289 


21 


18 


Israel 


70 


63 


215 


278 


32 


46 


Ca^•^ ia 


69 


62 


188 


304 


25 


13 


France 


69 


64 


174 


370 


25 


29 


Scotland 


68 


61 


191 


324 


24 


23 


Spain 


68 


55 


188 


285 


29 


33 


United States 


67 


55 


178 


338 


23 


5 


Ireland 


63 


61 


173 


323 


27 


39 


Jordan 


57 


40 


191 


260 


27 


63 


Special Populations 




England 


69 


61 


192 


30C 


22 


24 


China 


67 


80 


251 


305 


48 


43 


Portugal 


63 


48 


172 


334 


25 


56 


Sao Paulo. Brazil 


53 


37 


181 


271 


38 


60 


Fortaleza, Brazil 


46 


32 


183 


223 


32 


62 


Mozambique 


N/A 


28 


193 


272 


51 


9-5. 



* School Questionnaire 

** Problems identified in the school questionnaire included overcrowding, shortage of textbooks, shortage of 

educational materials, student absenteeism, student discipline, vandalism* (See Figure 22 for details.) 
N/A Information not available. 
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Figure 2.1 (conticued)* Education Systenr.s and Average Percent Correct 





Average % 
Conect in 
Science 


Average % 
Correct in 
Math 


Average Days 
of Instruction 
in Year* 


Avg. Mmutes 
of Instruction 
in School 
Each Day* 


Average 
Class Size for 
Grade 8* 


% of Schools 1 
With One or 1 
More Serious | 
Problems** |j 


j CaBiadian Populatians/IAEP 
__A^ 


67 


58 










Alberta 


74 


64 


190 


315 


23 


5 


British Columbia 


72 


66 


190 


304 


25 


19 


Quebec - French 


/ 1 


69 


181 


303 


28 


1 1 


Saskatchewan - English 


70 


62 


194 


297 


21 


1 1 


Quebec - English 




66 


1 »1. 


302 


26 


14 


Nova Scotia 


Aft 


OO 


1 o7 


293 


24 


1 o 
1 0 


ManitoDa - bn^Iisn 


69 


58 


192 


312 


21 


10 




67 




1 87 


■^n4 


97 

At 1 


1 1 
1 1 




67 




1 04 






1 % 


New Brunswick - Engliiih 


66 


58 


185 


296 


23 


11 


Newfoundland 


66 


59 


187 


289 


24 


35 j 


Saskatchewan - French 


65 


68 


195 


309 


20 


21 I 


New Brunswick - French 


64 


61 


188 


303 


24 


27 1 


Ontario - French 


60 


53 


187 


300 


22 


20 1 



School Questionnaire 



** Problems identified in the school questionnaire included overcrowding, shortage of textbooks, shortage of educational 
materials, student absenteeism, student discipline, vandalism. (Sec Figure 2.2 for details.) 

Observations (Figure 2,1) 

Education systems vary from country to country but not necessarily in patterns that explain high 
and low achievement. For most countries, the average number of days of instruction in a year 
varies from 175 to 222. In China, the average of 251 days of instruction is dramatically higher 
than the norm. Korea and Taiwan also show a relatively high number, whereas Ireland and France 
show the lowest Alberta shows a higher number than the Canadian average but in general, 
students across Canada have about the same number of instructional days each year. 

The number of minutes spent on instruction each school day must be taken into account when 
comparing the number of instructional days. For example, tlie United States shows a slightly 
lower than average number of instructional days but reports a higher number of minutes of daily 
instruction compared with the overall average. France has the longest school day, compensating 
for the fewer number of instructional days each year. Alberta has a higher number of instructional 
minutes per day compared with other provinces. Similarly, Taiwan, France, Scotiand, the United 
States, Ireland, and Portugal report a high number of instructional minutes per day compared with 
most other countries. 

Student performance in this study does not appear to he related to class size. Of all participating 
populations, Switzerland has the lowest class size, wivli 18 students, followed by Italy, England, 
North America and the Soviet Union. Alberta reports an average of 23 students in each class. 
China, Korea, Taiwan, and Mozambique report large class sizes. 
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Figure 2.2 shows the degree to which different school-related problems exist in different countries. 



Figure 2.2. Age 13: Problems in Scbool*^ 1 




Number of 
Schools 
Participating; 


Percent of Schools ReportinR Problems as Moderate or Serious: I 


Overcrowding 


Textbooks 


Educational 
MatfirLals 


Student 

Ab ^vGntceism 


Suident 
Di^ioline 


Vandalism j 


Science Rsmk Order 
1 /lAEP Average 
















1 Korea 


110 


J I 


1 


C 1 


1 A 


A < 

45 


1 H 


Taiwan 


108 


Zo 


U 


O 1 


Z 


o 
o 


1 ' n 


B Switzerland 


397 


33 


c 
0 


9 


4 


1 6 


1 7 


Hungary 


144 


29 


6 


3 1 


12 


23 


3 1 


Soviet Union 


138 


n A 
/4 






24 


20 


1 0 


Slovenia 


114 


52 


1 3 


65 


7 


20 


28 


Hfn ill Q-D /\vTi sons 
CI 1 1111 «" IVUI Uaj^I 1 aLf 

Italy 


90 


12 


2 


39 


7 


26 


27 


Israel 


110 


61 


13 


25 


8 


22 


24 


Canada 


1373 


31 


13 


22 


1 1 


9 


4 


France 


103 


46 


4 


19 


12 


24 


19 


Scotland 


92 


10 


24 


18 


22 


12 


10 


Spain 


109 


36 


10 


47 


20 


30 


19 


United States 


96 


16 


7 


13 


18 


16 


8 


Ireland 


lie 


41 


14 


46 


23 


13 


10 


Jordan 


106 


63 


13 


48 


20 


13 


18 


Special Populations 




En)^land 


83 


28 


31 


33 


9 


19 


8 


China 


119 


41 


4 


40 


9 


12 


15 


Portugal 


89 


47 


22 


75 


34 


17 


16 


Sao Paulo, Brazil 


108 


22 


41 


60 


38 


51 


54 [ 


Fortaleza, Brazil 


118 


23 


58 


53 


24 


38 


47 


Mozambique 


13 


59 


85 


84 


39 


38 


77 1 



* School Questionnaire 
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Figure 2.2 (continued). Age 13: Problems in School* 




Number of 
Schools 
ParticiDalin2 


Percent of Schools Reporting Problems as Moderate or Serious: 


Overcrowding 


Textbooks 


Materials 


Absenteeism 


Discipline 


Vandalism 


1 Canadian Pops/IAEP 
1 Average 
















1 Alberta 


119 


30 


6 


17 


12 


6 


1 


1 British Columbia 


105 


25 


13 


23 


34 


15 


12 


1 Quebec - French 


106 


35 


2 


11 


10 


15 


4 


9 Saskatchewan - English 


140 


27 


12 


13 


15 


8 


2 


I Quebec - English 


83 


22 


9 


18 


13 


10 


8 1 


Nova Scotia 


108 


38 


8 


20 


14 


17 




Manitoba - English 


115 


19 


8 


15 


9 


10 


6 


Ontario - English 


123 


34 


18 


25 


5 


4 


4 


Manitoba - French 


46 


Z J 


zz 


J 1 


1 1 


1 1 




New Bruns. - English 


100 


28 


11 


32 


14 


28 


12 


Newfoundland 


108 


33 


6 


41 


32 


13 


11 


Saskatchewan - French 


30 


41 


14 


41 


6 


10 


6 


New Brunswick - French 


70 


44 


13 


31 


22 


28 


5 


Ontario - French 


117 


31 


17 


27 


12 


12 


7 



* School Questionnaire 

** The total number of schools for all provinces is 3 less than reported for Canada as a result of 3 schools being dropped due 



to special circumstances. 

Observations (Figi:<e 2.2) 

The four lowest performing populations report a high incidence of problems in their schools, as do 
two higher performing populations, Sloveni*: and the Soviet Union. Alberta results show that a 
relatively low percentage of schools perceive the variety of problems surveyed to be of a moderate 
or serious nature. It is interesting to note that the Soviet Union has an average class size of 22 
students, and yet 74% of schools report overcrowding to be a moderate or serious problem. 
Generally, the most serious problem reported by each population is overcrowding. Student 
discipline appears to be of less concern when compared with overcrowding and general availability 
of educational materials. In addition, a high percentage of schools in some countries report a 
shortage of educational materials as being a moderate to serious issue. For example, 5 1% of 
Korean schools report this to be a problem. 
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SECTION 3: SCIENCE RESULTS 



In Alberta, 1459 students were sampled to write the science portion of the study and to answer 
related background questions. Interesting aspects of curriculum-related information, classroom 
characteristics, students and their homes, and education systems are presented. 

Summary of Science Information 

Two areas in which Alberta stands out are Nature of Science, and Integrates Science. Students 
were required to generalize, hypothesize, and reason by synthesizing specific information. The 
Alberta results are interesting when considered with the infomiation that shows that Alberta 
students do experiments on their own more often than students in other participating countries do. 

The emphasis that schools place on many of the sub-topics varies dramatically and cannot 
consis'tently be linked to perforaiance. Curiously, Alberta schools report a lower emphasis on 
Nature of Science sub-topics (when compared witii die Canadian average^ and yet Alberta ranked 
first overall. The results that show Alberta students conduct experiments fairly often may support 
Alberta's high overall performance. 

The findings that describe classroom factors highlight the variation in practices among countries. 
The majority of Alberta's 13-year-old students tend to spend one hour on science homework each 
week, do not have weekly science quizzes, listen to science lessons approximately 45% of the 
time, and conduct experiments fairly often. Science classes are never based on ability in Albma, 
and only 2% of Alberta schools report that they do not have a science laboratory. Approximately 
one-half of Alberta schools use specialists to teach science, and over 65% of those teaching tiie 
course have taken some post- secondary training in science. Alberta spends more time on science 
instruction each week compared to the Canadian average. All these factors indicate a greater focus 
on science in Alberta than in most other countries. Perhaps this emphasis helps to explain the high 
performance of Alberta students. 

The information reported about students and their homes shows variation between countries. 
Nine percent of Alberta's 13-year-olds report receiving instruction in a language different &x)m that 
spoken at home. This age group is much more likely to spend their time watching television than 
studying. Overall, science achievement is positively related to the number of books in the home in 
each population. There is also a positive relationship between leisure reading and science 
achievement in the majority of populations. 

The gender information provides some interesting differences for 13-year-old males and females 
in Alberta. Approximately 50% of females feel they are good at science compared with 
approximately 70% of males. A significantly lower percentage of females feel science is useful in 
their daily lives; however, there is only a 1% difference between lale and fenoale responses to the 
question "Science is more for boys than girls." Obviously, genoer differences continue to exist in 
science. Performance levels show that females continue to perform at lower levels than males. 

Only 19% of Alberta students agreed with the statement "Facts and ideas about science cannot be 
questioned or changed." This is much lower than the overall average and perhaps is a result of 
Alberta students conducting experiments more often. Having a questioning attitude is a goal that is 
supported tiirough Alberta's science education programs. 

Information about countries and their education systems provides an important context for 
understanding the relative performance of participants. Performance levels do not seem to be 
linked directiy to class size, as noted from the high performance of students in Korea and Taiwan 
and the low performance of some participants with relatively lower class sizes. 
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Although some consistent relationships between certain background chs^racteristics and 
achievement can be noted, they do not occur often. Factors diat impact on academic performance 
interact in complex ways and appear to operate differently in different cultures and education 
systems. 



Science Performance of 13-Year-Old Students 

Figure 3 A shows the overall results for all participating populations. It reports science 
performance for males and females as well as average scores for performance on science topics and 
cognitive processes. Below is a brief description of each topic and cognitive process: 

Life Sciences: Students are able to classify plants and animals, know forms of animal adaption, 
know the basis of animal behavior, and understand interaction/mterdependence within ecosystems. 

Physical Sciences: Students know and understand concepts such as time, matter, and energy. 

Earth and Space Sciences: Students demonstrate knowledge and understanding of concepts 
such as the solar system, the universe, and the water cycle. 

Nature of Science: Students knov/ and can use scientific inquiry skills. Highlighted in the 
lAEP were observing, classifying and inferring, interpreting data, and conducting inquiries. 

Knows (Knowledge): Students have a knowledge base to solve simple problems. 

Uses: Students use factual knowledge and apply basic scientific facts and principles in one or 
two-step processes. 

Integrates: Students can bring together a variety of knowledge and skills to solve more complex 
problems. 



15 




Figure 3.L Science, Age 13: Distribution of Percent Correct Scores by Country/Province 
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This country drew its sample from less than its total student population. 
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Figure 3.1 (continued)* Science, Age 13: Distribution of Percent Correct Scores by Country/Province 
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Observations (Figure 3.1) 

The results are presented for four content areas— Life Sciences, Physical Sciences, Earth and Space 
Sciences, and Nature of Science — and for three levels of cognitive processing— Knows Science, 
Uses Science, and Integrates Science. Alberta students performed very well in all areas, especially 
in Nature of Science. Also of note is Alberta's performance in Integrates Science, which is the 
highest of all project participants. 

Finally, results show that significant differences between male and female performance levels 
continue to exist A gender difference is evident in all participating populations, with males 
consistently outperforming females. The smallest gender differences are found in New Bmnswick 
(French), Taiwan, and Jordan. In Alberta, boys scored on average four percentage points higher 
tfian girls. An exception to this trend is found in the results for Nature of Science. But for Alberta 
and Manitoba (French), all Canadian populations show girl, scoring equal to or higher than boys 
in this content area. Similar results are evident in 13 of die participating countries. These results 
demonstrate that gaps continue to exist between male and female performance levels in spite of the 
special attention afforded this issue over the years. 



Curriculum Emphasis 



Figure 3.2 examines the percentage of schools reporting to emphasize on sub-topics in the four 
content areas. 



Figure 3.2. Science, Age 13: Emphasis for AH Major Topics'** 
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♦ School Questionnaire; information for other countries is reported in Learning Science: lAEP n 
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ObservatiG.iS (Figure 3.2) 



There is a substantial variation in what sub-topics are emphasized for the different populations. 
These differences in emphasis from topic to topic cannot always be consistently related to 
performance. There are some general trends. For example, Hungary reports a high emphasis on 
Life Sciences sub-topics and shows high performance scores in this area. Alberta's lower 
performance corresponds to a lower emphasis on Life Science sub-topics. 

The emphasis on the Physical Sciences sub-topics varies considerably from population to 
population. In Korea and Hungary, for example, a high percentage of schools report emphasis on 
Electricity and Magnetismi, whereas British Columbia and Quebec (French) show a high percentage 
of schools reporting emphasis on Solids, Liquids and Gases. No consistent pattern emerges when 
comparing emphasis and performance on the Physical Sciences questions. Manitoba (French) and 
Ontario (ftench) both repon a relatively high emphasis on the Physical Sciences sub-topics, and 
yet both populations scored lower on this content area when compared with their overall 
performance scores. Alberta schools reported a lower emphasis on the Physical Sciences sub- 
topics compared with the Canadian average, and yet Alberta students scored higher than the 
Canadian average in Physical Sciences. 

As with the other content areas, the patterns are not consistent for Earth and Space Sciences, 
although some general trends do emerge. For example, Taiwan stands out in the very low 
emphasis reported for Earth and Space Sciences sub-topics and scored 72% on this content area 
compared with an overall performance score of 76%. Alberta reported a higher percentage of 
schools emphasizing this sub- topic compared with the Canadian average and scored 74%, only 1 % 
behind top-performing Korea. 

Alberta reported a lower percentage of schools emphasizing Nature of Science sub-topics 
compared with the Canadian average. Yet Alberta students scored 84% on this content area — 
ranking first overall. The Nature of Science questions compare favorably with Alberta's "process 
skill" approach in the teaching of science. The low curriculum emphasis reported by schools may 
not have reflected this aspect of curriculum emphasis. High performance in science would seem to 
be related to factors other than just curricular emphasis in schools. 
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Classroom Characteristics 

The information reported in this section was collected from students and school administrators. It 
highlights the variation in teaching practices and classroom factors across various populations. 



Figure 3.3. Science, Age 13: Teaching Practices and Average Percent Correct 
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Observations (Figure 3.3) 



Alberta and British Columbia, the two top-performing provinces, spend more time on science 
instruction each week compared with the Canadian average. The majority of populations report an 
average of 150 to 200 minutes spent on science instruction each week. TTie average is higher in 
Taiwan, Hungary, and the United States (between 200 and 250 minutes each week), and very high 
in China and the Soviet Union (between 330 and 390 minutes each week). Korea, Saskatchewan 
(French), Ontario (Frenc'^), and Ontario (English) show a relatively shorter length of time spent on 
science instruction G^ss Uian 145 minutes each week). 

The United States, Jordan, and especially the Soviet Union all report a relatively high percentage of 
students who spend theu- instructional time listening to tiieir teachers explain science lessons every 
day. Nova Scotia, Manitoba (English), and Alberta are well above the Canadian average for the 
number of students reporting that they listen to science lessons daily. 

Taking tests and quizzes at least once a week is common in some places. The results from the 
Soviet Union and Taiwan (botii high-performing populations) and Jordan and the United States 
(both lower performing populations) indicate that weekly quizzes are used extensively to evaluate 
student performance in science. The relationship between frequent testing and overall perfomiance 
is not consistent for the school -administered or teacher-administered tests that were reported in this 
study. In general, most populations do not report a majority of schools administering science tests 
on a weekly basis. 

A consistent relationship between the amount of time spent on homework and science achievement 
is not evident The majority of students from most populations spend between 0 and 1 hour on 
science homework each week. The Soviet Union is an exception, with 59% of students reporting 
that they spend four hours or more on science homework each week. 
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The information about teaching practices and the relationship to science achievement is examined in 
Figure 3.4. 



Figure 3»4» Science, Age 13: Relationship of Teaching Practices and 
Average Percent Correct Within Populations 
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lAEP n results indicate that science instruction with frequent teacher presentations is positively 
associated with performance. Canada is the only population where students using hands-on 
activities was positively related to science performance. 



The use of computers and hands-on activities, such as work in science laboratories, is increasingly 
being advocated by science educators as a central part of learning and developing scientific skills. 
The information reported in Figure 3.5 shows that access to laboratories and computers varies 
from country to country. 
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Figure 3.5. Science, Age 13: Teaching Materials and Average Percent Correct 
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** School Questionnaire 



Observations (Figure 3.4 and 3.5) 



The relationship between the variables examined and achievement are is consistent across the 
participating countries. Some students have fewer opportunities to conduct experiments as access 
to laboratories varies significantiy from population to population. Still, the majority of schools in 
most populations indicate that students have access to a general or specialized laboratory. 

Few schools in the Canadian provinces are without the benefit of having a lab. Ontaiio (English) 
is an exception, with almost one-half of schools reporting that they do not have a science 
laboratory. Although Korea and Taiwan report almost universal access to labs, botii countries 
have a relatively high percentage of students reporting that they never do experiments (see Figure 
3.3). Perhaps this is a result of the large class sizes. Alberta has the lowest percentage of schools 
in Cmadsi that report not having a science laboratory — 2% compared to the Canadian average of 
25%. The commitment in Alberta to the development of science process skills througji hands-on 
experimentation seems to be supported through facilities that include laboratories for student use. 

Access to computers also varies vastiy among tiie participants. Very few populations indicate that 
they have enough computers that would allow students to use them for school work. Alberta, the 
United States, and British Columbia report having from 24 to 37 computers in each school that 
students can use for school work. This is high compared to other participants in the study. 



Figure 3.6 reports information on the academic background of the teachers responsible for teaching 
science. It also shows the percentage of schools that report assigning students to science classes 
based on ability. 
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Figure 3.6. Science, Age 13: Teacher Background, Classroom Organization, 

and Average Percent Correct 
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** School Questionnaire 



Observatsons (Figure 3.6) 



In Canada, teachers of science also teach other courses of study more often than science teachers in 
other countries do. It is also interesting to note that in Korea and Ontario (French), only 10% of 
teachers teaching science have taken post-secondary science courses. The Canadian provinces 
report large differences in their responses. Quebec (English) and British Columbia report the 
highest percentage of science teachers with post-secondary courses in science. Taiwan reports that 
100% of teachers teach science most or all of the time. Approximately one-half of Alberta schools 
use specialists to teach science, and over 65% of those teaching science have taken some post- 
secondary tiaining in science. 

Only Taiwan rej)orts a high percentage of schools that organize science classes on the basis of 
ability. Alberta schools report that they never do this. The highest achieving populations, wir^ jie 
exception of Taiwan, do not assign students to science classes on the basis of ability. 
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Students and Their Homes 



The lAEP study collected descriptive information about the students themselves and their families. 
Figures 3.7, 3.8, 3.9, and 3.10 report this information. 



Figure 3*7. Science, Age 13: Home Characteristics^ and Average Percent Correct 
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*Student Questionnaire 
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1 Figure 3.8. Science, Age 13: Relationship of Home Characteristics 
1 and Average Percent Correct Within Populations 
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Observations (Figure 3.7 and 3.8) 



More than 12% of students living in Canada, Switzerland, and the Soviet Union report that they 
receive instruction at school in a language different from die one spoken at home. In 
Saskatchewan (French), almost 90% of students report that a different language from the one used 
in school was spoken at home. 

Family size is generally smallest in mdustrialized nations. For example, only 7% of 13-year-olds 
in Canada report that they have four or more brothers and sisters. In Jordan, 88% of students 
indicate that they come from families where there are four or nnore children. In general, science 
performance is higher for students from smaller faniilies. 

The role of language and the opportunity to read by having material at home is important in 
learning and is positively related to performance in science (Figures 3.7 and 3.8). In Alberta, 
parental interest in science is also positively linked to student performance in science. In this case, 
a North American cultural effect exists which is not generally consistent in other countries. With 
the exception of North America and Korea (Figure 3.8), a significant relationship between parental 
interest in science and student achievement does not exist 
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Figures in 3.9 and 3.10 examine some out-of-school activities that may be related to science 
achievement 



Figure 3.9. Science, Age 13: Home Activities'^ and Average Percent Correct 
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* Student Questiomiaire 

** Students were asked to what extent they agreed with the following statements: Much of what is learned in 
science is useful in everyday life; It is important to know some science to get a good job; I am good at science; 
My parents are interested in science. Their responses were combined to form an index of attitudes toward science. 
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Figure 3.10. Science> Age 13: Relationship of Home Activities &nd 
Average Percent Correct Within Populations 
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Observations (Figures 3.9 and 3.10) 



How students spend their time outside of school hours provides interesting information and 
comparisons. Consistent reading is positively related to achievement in the majority of 
populations; however, the lowest percentage of daily readers reportai was in Korea (1 1%) and 
Taiwan (17%), two countries that achieved the highest overall science scores. Alberta reports that 
37% of their 13-year-olds read for fun almost every day. 

In Canada, many provinces showed a negative relationship between time spent on all homework 
and science achievement All other panicipating populations show either no relationsWp or a 
positive one. In Jordan, Hungary, and the Soviet Union, a higher percentage of students report 
that they spend two hours or more on all homework every day. Generally, students in Canaida and 
Switzerland report spending the least time overall on homework. In Alberta, students who spend 
the most time doing homework perform at lower levels. 

The amount of time students spend watching television is related to performance. With very few 
exceptions, the more television students watch the lower their performance scores. In the United 
States, slightly more than one-fifth of 13-year-olds report watching five hours or more of 
television every day compared to 14% of Alberta students. 

Finally, a positive attitude toward science is likely to result in better performance. This trend 
exist^ for nearly ail populations. 
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Figure 3.1 1 probes students attitude toward science. The percentage of males and females 
agreeing with the statements is reported for Alberta^s students. 



- 

Figure 3.11. Science, Age 13: Attitudes Towards Science* and Average Percent Correct 
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Observations (Figure 3.11) 



Having a positive attitude toward science is positively related to science achievement in the majority 
of populations. In some cases, though, strong beliefs about being good at science did not relate to 
higher performance. In Ontario (French), for example, almost 80% of students feel they are good 
at science. In Taiwan and Korea, both high performers, only 19% and 25% respectively perceived 
themselves as being good at science. Alberta students responded in a manner similar to most other 
students in Canada, with slightly more than half of them indicating they believe they are good in 
science. 

The majority of students feel that what they learn in science is useful in their everyday life. 
Curiously, North American students were less likely to see science as being useful. The majority 
of students report that it is important to know some science to get a good job. Korea and 
Switzerland are the exception s; only 35% of Korean 13-year-olds and 45% of Swiss students feel 
that they need some science to get a good job. Students in Alberta believe science is important 

Alberta's results indicate that our students have a healthy, questioning attitude; only 19% of 
students feel that they cannot question or change science facts and ideas. The curriculum in Alberta 
encourages students to question ideas and to apply scientific skills in order to understand the world 
they live in. In Alberta, 85% of females feel they can question science ideas compared to 77% of 
males. British Columbia, the Soviet Union, and the United States display similar results. A 
majority of students in Hungary and Jordan feel science ideas are not to be questioned. 
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SECTION 4: MATHEMATICS RESULTS 



The, information in this section shows the results for niathemaUcs. In Alberta 1422 students were 
sampled to write the mathematics portion of the study and to answer related background questions. 

The infomiation is displayed according to categories that were used in the overall smdy report: 
mathematics performance of 13-year-olds, curriculum-related information, classroom 
characteristics, students and their homes, and education systems. 

Summary of Mathematics Information 

This study provides information on the context for learning mathematics. Alberta's 13-year-old 
students report that they spend 0 to 1 hour on mathematics homework each week, do not have 
weekly mathematics quizzes, listen to mathematics lessons approximately 60% of the time, and 
seldom or never use mathematics tools, but they do use calculators and computers. 

In Alberta, mathematics classes are not based on ability* As well, about one-half of students repon 
completing exercises on their own every day and slightiy over one-third work in small groups to 
solve problems at least once a week. Slightiy more than one-half of the teachers teaching 
mathematics to 13-year-olds are specialists. 

It is interesting to note that although China, KcM-ea, and Taiwan report a very high percentage of 
specialists teaching mathematics, a relatively low percentage of teachers have post-secondary 
courses in mathematics. An interesting research question would be the amount of inservice 
training in instructing mathematics that these teachers are receiving. 

Alberta's performance in mathematics varied; Alberta students performed well in some areas and 
not so well in others. One area where Alberta students did do well was in, "Data Analysis, 
Probability, and Statistics." The two areas that Alberta performed lowest in were "Geometry" and 
"Algebra and Functions." 

Fifteen percent of the assessment was devoted to Geometry. Four questions dealt directiy with 
knowing the measures of an angle when given other information to permit calculations. Alberta 
students performed poorly when calculating the measure of an angle from supplementaiy angles, 
the angles of a triangle, or in right angles. According to the Alberta programs of study, students 
should know how to do these calculations. 

In Algebra and Functions, students were required to express relationships in equations, to 
substitute numbers for variables, and to solve equations for one variable. According to Alberta's 
programs of study, students should be able to solve expressions such as [16+3y, y=-2], 
[2x+4=10, solve for x], and [n(n+2), when n=4]. Alberta's performance was well below the 
performance levels of most other participants in the study. Students were able to match algebraic 
expressions to written statements, showing that Alberta students have a good conceptual 
understanding of Meriting number sentences. Many top-performing countries, with the exception of 
Switzerland, tend to plaoe a heavy emphasis on algebra at this age* 

Finally, there is room for improvement in certain areas of mathematics. This smdy clearly points 
out at least two areas where performance was below what was expected: "Geometty" and "Algebra 
and Functions." 



oo 

-29- 



Mathematics Performance of 13- Year-Old Students 

Figure 7 shows the overall results for participating populations. It reports mathematics 
performance for males and females, as well as average scores for performance on mathematics 
topics and cognitive processes. Below is a brief description of each topic and cognitive process. 

Numbers and Operations: Students show they know numbers, can compute (+, x, -^X and 
can apply ratios and percentages. 

Measurement: Students show they know and can use measurements of length, time, money, 
temperature, mass/weight, area, and angles. 

Geometry: Students show they can describe, compare, and classify geometric figures; visualize, 
draw, and construct geometric figures; and apply tiiis knowledge in solving problems. 

Data Analysis, Probability, and Statistics: Students show they can read, interpret, and 
make predictions using tables and graphs, and they can calculate averages and create graphs (bar, 
line, etc.) 

Algebra and Functions: Students can write symbolic expressions and verbal statements 
(e.g., number sentences with one or two variables), solve simple equations (e.g. y=x+2, find y 
when X is 9, etc.), and solve problems that require setting up equations and solving for one 
variable. 

Conceptual Understanding: Students show an understanding of mathematics principles (e.g., 
division), and can recognize, interpret, and apply the signs, symbols, and terms used in 
mathematics. 

Procedural Knowledge: Students know what to do to solve a problem and can use basic 
knowledge and skills to complete tasks. 

Problem Solving: Students show skill in using reasoning and analytic abilities, and can judge 
the reasonableness of answers. 
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Figure 4.1 shows the overall results for all populations. 
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Figure 4.1. Mathematics* Age 13: Distributioo of Percent Correct Scores by 

Country/Province 
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Figure 4«1, continued* MathenaaticS) Age 13: Distribution of Percent Correct Scores by 

Country/Province 
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Observations (Figure 4.1) 



The average score across all populations was 58%. Students in Alberta, with an overall average of 
64%, were outperfornied by students in Quebec (French and English), British Columbia, and 
Saskatchewan (French). Alberta's performance is in the middle compared with the performance of 
ether participants; this does not meet the provincial expectation of performance that compares 
favorably with the best in the world. 

The results are presented for five content areas — Numbers and Operations, Measurement; 
Geometry; Data Anal vsis. Probability, and Statistics; and Algebra and Functions — and three levels 
of cognitive processing — ConceptusJ Understanding, Procedural Knowledge, and Problem 
Solving. The content area of Measurement received the lowest overall lAEP score, only 47%. 
Alberta students scored an average of 54% on measurement questions. They did well in most 
content areas with the exception of Algebra and Functions and some aspects of Geometry. 
Alberta^s results in Algebra and Functions and in Geometry were its lowest of the five content 
areas assessed. 
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Curriculum Emphasis 

Figure 4.2 examines the percentage of schools reporting to emphasize sub-topics within the content 
areas. 



Figure 4.2. Matbematics, Age 13: Emphasis For All Major Topics* 
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Observations (Figure 4.2) 



Patterns of instruction and emphasis on the sub-topics vary from population to population. Most 
countries still emphasize Numbers and Operations at age 13. Korea, Taiwan, and China are all 
high-performing populations that do not emphasize the various Numbers and Operations sub- 
topics as much as other populations do. 

Some general patterns are noted in these results. For example. Alberta students scored an average 
of 54% on Measurement, above the overall lAEP n average of 47%. This correlates with our 
relatively high emphasis on Measurement With the exception of Switzerland, the higha* 
performing populations do not emphasize Measurement at this age. 

The emphasis on Geometry varies considerably from population to population. China, Hungary, 
Korea, the Soviet Union, and Ontario (French) report a high emphasis on Geometry. With the 
exception of Ontario (French), all of these populations performed very well in Geometry. Taiwan 
does not emphasize Geometry at this age, and yet they performed very well in this area. Alberta 
schools report a lower emphasis en Geometry (34%) compared witli high-perfonxung countries 
like Hungary (79%). 

There is substantial variation in emphasis on the three sub-topics in Data Analysis, Probability, and 
Statistics. There is heavier emphasis on tables and graphs than on probability or statistics. Korea 
and, to some extent, Taiwan and Ontario (French) stand out in the higher emphasis reported on this 
content area. With the exception of China, every population scored higher on this content area 
compared with their overall performance scores. Although not reporting a high emphasis on this 
area. Alberta performed at 80% on Data Analysis, Probability, and Statistics. 

Alberta schools report a lower emphasis on Algebra compared with other populations. 
Alberta smdents scored 52% on Algebra compared with tiie overall lAEP average of 54%. With 
the exception of Switzerland, high-performing populations report a high emphasis on Algebra: 
China 94%, Hungary 90%, Korea 86%, Taiwan 74%, and the Soviet Union 96%. The four 
Canadian populations that report a higher emphasis on Algebra compared with other Canadian 
populations are Quebec (French), New Brunswick (French), Manitoba (French), and Ontario 
(French). These populations did not perform at correspondingly high levels. 
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Classroom Characteristics 

The information reported in this section was collected from students and school administrators. 
It highlights the variation m teaching practices and classroom factors across various populations. 



Figure 4.3. Mathematics, Age 13: Teacliing Practices and Average Percent Correct 
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Figure 4.4 presents information about the relationship between teaching practices and mathematics 
performance. 



1 Figure 4.4. Mathematics, Age 13: Relationship of Teaching Practices and | 
R Average Percent Correct Within Populations | 
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4- Statistically significant positive relationship 
- Statistically significant negative relationship 
0 No statistically significant lineai iclationship 




Observations (Figure 4.3 and 4.4) 



The different features of educational programs help to describe the learning context in various 
places. The majority of populations report an average of 200 to 250 minutes being spent on 
madiematics instruction each week. The average is slighdy higher in the Soviet Union and 
Switzerland and is especially high in China (307 minutes each week). Korea, Hungary, and 
Jordan show a relatively shorter length of time spent on math instruction (between 179 and 186 
minutes each week). Quebec (French and English), Newfoundland, and New Branswick (French) 
report the largest amount of time for mathematics instruction; Alberta schools spend on average of 
214 minutes on mathematics instruction each week. 

Reported classroom activities provide interesting comparisons. For example, 78% of students in 
China report that they do mathematics exercises on tlieir own every day compared with 62% in 
Quebec (French) and 50% in Alberta* Independent work is positively related to mathematics 
achievement in the majority of populations. Also interesting is the negative relationship between 
solving problems in small groups and achievement This may be because paper and pencil tests 
cannot measure important skills that are developed in small-group learning experiences. 

The relationship between testing and performance is not consistent. The majority of participants do 
not use mathematics tests or quizzes on a weekly basis. Thirty-eight percent of Alberta students 
report taking a math quiz on a weekly basis. Quebec (French) reports regular use of weekly 
quizzes or tests. 

The majority of students spend between 0 and 1 hour on mathematics homework each week. 
China is an exception, where 37% of students reporting that they spend four hours or more on 
math homework each week. The Soviet Union, Korea, and Taiwan, where 24% to 33% of 
students report spending m.ore than four hours on math homework each week, are higher than the 
norm. Results from China, the Soviet Union, Korea, and Taiwan show a positive relationship 
between the amount of time spent on mathematics homework and performance. Curiously, Nova 
Scotia is the only Canadian population where there is a positive relationship between mathematics 
performance and time spent on mathematics homework. In Alberta, 15% of students report that 
they spend four hours or more each week on mathematics homework. This was not found to have 
either a positive or a negative effect on their performance in Mathematics. 
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The information reported in Figure 4.5 indicates the extent to which manipulatives and new 
technologies have been integrated into schools. 



Figure 4*5* Teaching Materials and Average Percent Correct 




Average 
Percent 
Cornea 


Percent of Students Who: 


Average 
Number of 

C^Oftmiit^*rQ in 

^p'Ulli^UU&l o All 

School** 


Wnrk- With 
wunt wiui 

Math Tools at 
Least Once a 
. Week* 


OVA it 

Calculator* 


Calculators in 
School* 


Ever Use 

for School 

Work or 
HomewOTk* 


Populations 














Canada 


62 


14 


91 


75 


42 


17 


Albeita 


64 


13 


92 


85 


52 


26 


British Columbia 


66 


11 


92 


83 


51 


37 


Manitoba - English 


58 


13 


84 


53 


42 


15 


Manitoba - French 


63 


10 


88 


55 


35 


18 


N. Bruns. - EngL 


58 


19 


89 


87 


29 


13 


N. Bnins. - French 


61 


12 


87 


72 


11 


8 


Newfoundland 


59 


25 


93 


89 


35 


7 


Nova Scotia 


60 


18 


86 


60 


41 


12 


Ontario - English 


58 


16 


91 


74 


53 


15 


Ontario - French 


54 


16 


90 


75 


46 


14 


Quebec - Enj2jlish 


66 


20 


92 


73 


16 


15 


Quebec - French 


69 


10 


92 


76 


43 


18 


Sask. ' English 


62 


15 


86 


67 


49 


14 


Sask. - French 


68 


13 


83 


73 


40 


10 


Other Interesting 
Comparisons 




China 


80 


40 


21 


7 


6 


2 


9 Hungary 


68 


43 


87 


71 


31 


6 


1 Jordan 


40 


39 


53 


5 


5 


1 


1 Korea 


73 


17 


20 


4 


10 


15 


1 Soviet Union 


70 


32 


47 


19 


6 


2 


Switzerland 


71 


36 


85 


51 


25 


4 


Taiwan 


73 


38 


58 


62 


6 


15 


United States 


55 


18 


89 


54 


37 


24 



* Student Quesdonnaiie 
** School Questionnaire 



ERIC 



-38 



Observations (Figure 4.5) 



The use of math manipulatives, calculators, and computers is not yet a part of mathematics 
instruction in most populations. Alberta, other Canaxiian provinces, Korea, and the United States 
report a relatively low percentage of students that work with concrete mathematics materials. 
Students in China, Hungary, Jordan, and Taiwan are higher than the norm; approximately 40% of 
students from these countries indicate working with matfiematics tools at least once a week. 
Overall, results show that most students do not use manipulatives when learning mathematics. 

Ownership of calculators is common except in Korea, China and to some extent, the Soviet Union, 
Taiwan, and Jordan. Although the use of calculators in school is common in Hungary, in the 
Canadian provinces and, to some extent, in Taiwan, students in most countries report using 
calculators in school infrequently. 

Overall, computer use is even more infrequent than calculator use. The majority of students report 
that they never use a computer for school work or homework. Alberta, British Columbia, and 
Ontario (English) are the only places where over one-half of students report using a computer for 
school work or homework. Very few populations indicate that they have enough computers for 
students to use on a regular basis for school work. Alberta, British Columbia, and the United 
States do have this benefit, as they report having from 24 to 37 computers in each school. 
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Figure 4.6 reports infonnation about teachers and about the percentage of schools reporting to 
assign students to mathematics classes based on ability. 



Figure 4.6. Mathematics, Age 13: Teacher Background, Classroom OrganizaMon, 1 

and Average Percent Correct | 
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Observations (Figure 4,6) 



In Alberta, 53% of teachers who teach 13-year-olds mathematics teach mathematics most or all of 
the time. China, Korea, the Soviet Union, Taiwan, the United States, and Jordan report that 
approximately 90% of teachers teaching mathematics teach mathematics most of the time. 

In Hungary, mathematics teachers universally have post-secondary courses in mathematics. 
China, Korea, and Taiwan, other high-performing populations, report a low percentage of teachers 
with post-secondary courses in mathematics. Albeita and British Columbia results show that more 
than one-half of teachers teaching mathematics have post-secondary courses. This figure is above 
the Canadian average. 

The highest achieving populations, with the exception of Taiwan, do not group by ability. 
In British Columbia, 26% of schools report using ability to ^up students in matiiematics classes. 
In Taiwan, 63% of schools report organizing their mathematics classes on the basis of ability. In 
Alberta, only 2% of schools report using the practice. 
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Students and Their Homes 



Figures 4.7, 4,8, 4.9, and 4.10 report information about students themselves and their homes. A 
number of questions examined how students spend some of their time outside of school in ways 
that may enhance their in-school performance. 



Figure 4.7. Mathematics, Age 13: Home Characteristics'*' and Average Percent Correct 
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* Student Questionnaire 



N/A Information is not available. 



ERIC 



■42- 



48 



Figure 4.8. Mathematics, Age 13: Relationship of Home Characteristics 
and Average Percent Correct Within Populations 
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The amount of time students spend in various out-of-school activities provides for some interesting 
comparisons. 



Figure 4.9. Mathematics, Age 13: Home Activities'*' and Average Percent Correct 
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* Student Questionnaire 

** Students in the assessment were asked to what extent they agreed with the following statements: 

Mathematics is useful in solving everyday problems. It is important to know some math to get a good job; I 
am good at mathematics; My parents want me to do well in mathematics. 
Their responses were combined to form an index of attitudes toward niathematics. 
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Figure 4. 10 shows whether the relationship between achievenment and increasing levels of a 
particular home-activity variable is positive, negative, or not related for each population. A study 
of the association between home activities and ms^liematics performance within populations relates 
the importance of how students spend their time away from school. 



j Figure 4.10. Mathematics, Age 13: Relationship of Home Activities and 
Average Percent Correct Within Populations 
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* Student Questionnaire - Statistically significant negative relationship 
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Observations (Figures 4.7, 4.8, 4.9, and 4.10) 



Many factors are related to student performance. This study addressed some of them. 

In every population, mathematics achievement is positively related to the number of books in the 
home. This relationship supports the importance of language in relation to performance. 

Most students in every population think that theu- parents want them to do well m mathematics. 
However, a lower percentage of students report that they discuss their mathematics class with 
someone at home. Support from a student's parents clearly contributes to better mathematics 
performance (Figure 4.8). 

Results indicate that parents help their children more often with their mathematics homework than 
with their science homework. Approximately three-quarters of students in Alberta, British 
Columbia, Newfoundland, Ontario (English), Saskatchewan (English), the United States, and 
Hungary indicated that they receive help at home witli their mathematics homework. Curiously, in 
China, the top-performing population, students spend more time on homework and receive less 
help at home than do students in other populations. 

The information reported on home activities and mathematics achievement is similar to that reported 
for science. Regular reading is positively related to achievement in the majority of populations. 
However, the lowest percentage of daily readers are in Korea (11%) and Taiwan (19%), both high- 
performing countries. In China, the top-performing country, only 28% of students report that they 
read for fun on a daily basis. In Alberta, 40% of participants report daily leisure reading. 

As in Science, there is a negative relationship between time spent on all homework and 
mathematics achievement in Canada. In contrast, there is a positive relationship between time 
spent on all homework and mathematics achievement in the majority of populations. Compared 
with other populations. Alberta reports a relatively low percentage of students spending two hours 
or more on all homework every day. Results for Alberta show no effect on achievement with 
increased time spent on homework. 

In many populations, there is a significant negative relationship between increased time spent 
watching television and mathematics performance. North American children report that tiiey spend 
more time watching television than do children in other countries. Twelve percent of participants 
in Alberta report watching five hours or more of television every day. In Alberta, as in many other 
populations, math achievement decreases as time spent watching television increases. 
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Figure 4.1 1 probes student attitudes toward mathematics. The percentage of males and females 
agreeing with the statements is reported for Alberta's students. 



Figure 4.11. Mathematics, Age 13: Attitudes Toward Mathematics"^ and Average Percent Correct 





Average 
Percent 


Percent of Students Agreeing with Statement 


lam Good 
at Math. 


Math is 
More for 
Boys than 

Girls. 


Math is Useful 
in Solving 

Everyday 
Problems. 


It is Important 
to Know Some 
Math to get a 
Good Job. 


Learning Math 
is Mostly 
Memorizing 


(Cnowini? Kow to 
Solve a Math 
rTOuicm IS as 
Important as 
(jetting tne 
Right Answer. 


Populations 
















Canada 


62 


70 


2 


83 


97 


58 


86 


Alberta** 


64 


63 
71/56 


2 

4/1 


80 
83/76 


97 
97/98 


57 
61/52 


83 
84/82 


British Columbia 


66 


60 


2 


78 


97 


59 


84 


Manitoba-EngL. 


58 


60 


2 


74 


95 


56 


81 


Manitoba-French 


63 


73 


2 


80 


93 


61 


88 


N. Bruns.-EnpL 


58 


54 


2 


78 


95 


51 


83 


N, Bruns.-French 


61 


70 


2 


83 


95 


75 


91 


Newfoundland 


59 


66 


2 


84 


98 


58 


86 


Nova Scotia 


60 


63 


1 


84 


98 


45 


82 


Ontario - English 


58 


68 


2 


84 


98 


59 


84 


Ontario - French 


54 


77 


3 


88 


98 


70 


91 


Quebec - English 


66 


67 


2 


79 i 96 


44 


83 


Quebec - French 


69 


78 


1 


Y 

84 ! 94 


56 


89 


Sask. - English 


62 


64 


2 


79 97 


57 


87 


Sask. - French 


68 


73 


2 


86 92 


60 


86 


Other Interesting 
Comparisons 




China 


80 


57 


1 


80 


66 


19 


67 


Hungary 


68 


32 


5 


72 


93 


54 


88 


Jordan 


40 


76 


15 


50 


77 


41 


82 


Koiea 


73 


22 


27 


82 


68 


13 


94 


Soviet Union 


70 


25 


14 


64 


85 


26 


78 


Switzerland 


71 


48 


8 


76 


90 


34 


89 


Taiwan 


73 


14 


15 


80 


81 


54 


87 


United States 


55 


64 


3 


76 


96 


1 56 


86 



* Student Questionnaire 

** Male/female percentages. Gender data not available for other populations. 
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Observations (Figure 4.11) 



Having a positive attitude toward mathematics is favorably related to mathematics performance in 
the majority of populations. In Alberta, more male students than females see themselves as being 
good at mathematics. In all participating North American populations, the majority of students feel 
they are good at math. However, tiiere is not a consistent pattern between student responses to the 
statement, "I am good at math" and performance. In Jordan, for example, 76% of students feel 
they are good at math, whereas in Taiwan, only 14% of participants feel this way. With the 
exception of China, students in the higher performing populations do not perceive themselves as 
being as good in mathematics as students from low-perfomoing populations do. Although not ac 
pronounced, a similar pattern is evident in attitudes toward science. 

Students in most populations feel mathematics is useful in solving everyday problems. Most 
students also agree that it is important to know some math to get a good job, especially in Canada 
and the United States, where an exceptionally high percentage of students agree with the statement, 
China is below the norm, with only 66% of participating students agreeing. Alberta students 
(97%) believe mathematics is important for getting a good job. 

Responses to the statement "Learning math is mosdy memorizing" ranged from 13% to 75% of 
students agreeing. China, Korea, and the Soviet Union report a relatively low percentage of 
students indicating that mathematics is mostiy memorizing. In Alberta, females are less inclined to 
view mathematics as mostly memorizing than are males. 

The majority of students display a healthy attitude in agreeing that knowing how to solve a 
mathematics problem is as important as getting the right answer. 



ERLC 



-48- 

54 



SECTION 5: GEOGRAPHY RESULTS 

The geography assessment was conducted as a minimal attempt to measure basic geography skills 
and was not planned to reflect a full range of geography knowledge and skills that might be 
considered important International dif feiences in performance on the geogr^hy assessment were 
not as pronoimced as they were on the mathematics and science assessments. In every 
participating population, students achieved the highest average percent correct on questions that 
measui^ the content area of geographic skills and tools* 

Nine countries including eight Canadian provinces administered this optional geography 
component. Nova Scotia and Prince Edward Island did not take part. In Alberta, 2881 students 
wrote the geography assessment and answered related background questions. 

The information is displayed in the following way: geography performance of 13-year-olds, topics 
that students report studying, and communication with parents and student activities. 

Summary of Geography Information 

There appear to be positive relationships between many background variables (books in the home, 
study of geographic topics, reading habits, intemation^ travel) and achievement in geography. 
The correlations between these faaors should be investigated more fully along with other 
background variables such as the different geography courses of study, student access to 
geographic reference materials, and smdent attitudes toward geography. For example, geography 
is not a separate subject in Alberta but is integrated into other subject areas. This fact needs to be 
considered when interpreting results. Overall, Alberta students demonstrate a good grasp of the 
geography concepts assessed. Alberta performed in the top third comjpared with other participants. 

Geography Performance of 13- Year-Old Students 

Figure 5.1 shows the overall results for participating populations. It reports performance on three 
main content and skill categories. Below is a brief description of each topic. 

Skills (Geographic Skills and Tools): Students show skill in using and interpreting 
information from maps, charts, and globes. 

Physical (Physical Geography): Students can identify physical features of land forms from 
maps and show an understanding of basic concepts of climate. 

Cultural (Cultural Geography): Students show an understanding of the location of cultural 
entities, such as countries, regions, language groups, and population concentrations, as well as an 
understanding of human impact on the environment. 
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Figure 5.1 shows overall performance for all populations that chose to participate in the Geography 
option. 



Figure 5.1. Geography, Age 13: Distribution of 
Percent Correct Scores by Country/Province 




Overall 

Average 
(%) 


Topic 


Skills 


Physical 


Cultural 


Populations 










lAEP II AveraRC 


61 


68 


60 


57 


Canada 


63 


70 


61 


58 


Alberta 


65 


71 


62 


61 


British Columbia 


67 


71 


67 


64 


Manitoba - English 


63 


68 


63 


58 


Manitoba - French 


61 


67 


59 


56 


N. Bnms. - English 


57 


63 


57 


50 


N. Bruns. - French 


55 


60 


54 


50 


Newfoundland 


57 


65 


56 


49 


Ontario - English 


62 


68 


61 


58 


Ontario - French 


52 


60 


49 


48 


Quebec - English 


67 


72 


64 


64 


Quebec - French 


64 


72 


61 


58 


Sa<;k - Fnp^li<sh 


63 


71 


60 


58 


Sask. - French 


61 


69 


58 


56 


Other Participating 
^^ounines 






70 


76 


68 


65 


Ireland 


59 


63 


60 


52 


Koiea 


60 


68 


52 


60 


Scotland 


58 


66 


57 


51 


Slovenia 


65 


68 


64 


64 


Soviet Union 


63 


72 


61 


53 


Spain 


60 


62 


59 


59 


United States 


62 


69 


58 


58 
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Figure 5.2 shows performance scores and the percentage of students who report studying 
particular sub-topics in school 

I " ~ = 

Figure 5.2. Geography, Age 13: Percentage of Students Who Report Studying Topics* 

and Average Percent Correct 





III 


Percent of Students Who Reported Studying Topic in School 


Geogra 


phy Skills & Tools 


Physical Geography 


Cultural Geography 


Reading 
Symbols 
on Maps 
& Globes 


Using 
Scales to 
Measure 
Distance 


Longitude 

anl 
Latitude 


Location 
of 

Continents, 
Oceans, 
Rivers, 

Mountains 


Climate 
& Natural 
Resources 


Location 
of Cities 
& 

Regions 
in Your 
Own 

v-^ounuy 


Location 

of 
Foreign 
Countries 

& 

Cultures 


Populations 


















Canada 


63 


91 


88 


94 


91 


84 


89 


75 


Albeita 


65 


89 


87 


96 


91 


86 


93 


84 


British Columbia 


67 


92 


90 


92 


91 


67 


82 


81 


Manitoba - English 


63 


89 


83 


92 


92 


85 


88 


78 


Manitoba - French 


61 


80 


88 


93 


89 


81 


84 


66 


R Bruns. - Engl. 


57 


79 


73 


76 


81 


60 


86 


59 


N, Bruns. - French 


55 


82 


83 


91 


89 


85 


88 


73 


Newfoundland 


57 


93 


92 


96 


91 


88 


85 


86 


Ontario - English 


62 


92 


87 


95 


92 


87 


90 


75 


uniano - rrencn 


52 


83 


87 


95 


89 


89 


87 


70 


VAieDcc xiiigusn 


67 


93 


89 


97 


95 


81 


90 


74 


Quebec - French 


64 


90 


94 


95 


94 


86 


89 


69 1 


Sask. - English 


63 


90 


88 


96 


91 


86 


91 


81 1 


Sask. - French 


61 


76 


88 


96 


87 


89 


86 


76 1 


Other Participating 
Countries 




HiiTiMrv 


70 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


Ireland 


59 


70 


67 


71 


84 


76 


85 


66 


Korea 


60 


65 


80 


74 


85 


85 


82 


81 


Scotland 


58 


87 


81 


75 


87 


80 


76 


64 


Slovenia 


65 


83 


80 


95 


92 


95 


87 


90 


Soviet Union 


63 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


1 Spain 


60 


54 


69 


88 


93 


92 


91 


76 


1 United States 


62 


94 


91 


94 


94 


84 


89 


82 



* Student Questionisaire. 

N/A Information is not available. 
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Observations (Figure 5.2) 



Alberta students report that they learn geography concepts in school in spite of not having a 
separate geography curriculum. This shows that geography concepts are studied thi'ough their 
integration into the science and social studies programs. 

When looking at results for all participants, there does not seem to be a consistent relationship 
between student reports of having studied P^iysical Geography topics and their performance on 
Physical Geography questions. For examr>le, over 90% of Slovenian students report that they 
study the Physical Geography topics and they perform quite well in this area- On the other hand, 
although Irish students report less emphasis on the two Physical Geography topics, they were the 
only group that, in relative terms, performed better on Physical Geography items than on the total 
assessment 

The lAEP n average on the Cultural Geography topics indicates that students did not perform as 
well on Cultural Geography questions as they did on the other two topics. Overall, there is a 
comparatively lower number of students that report studying the location of foreign countries and 
cultures. Ireland, Scotland, and New Brunswick (English) report the lowest percentage of 
students studying the location of foreign countries and cultures; these populations scored low on 
Cultural Geography in this assessment. 
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Communication with Parents and Student Activities 

The infonnation in Figure 5.3 is interesting and may suggest topics and questions for further study 
on future assessments. 



1 

Figure S3. Geography, Age 13: Communication With Parents, Student 
Activities* and Average Percent Correct 




Average 
Percent 
Correct 


Percent of Students Who: 


Have 
Traveled 

125 MUes 
from Home 
Town 


Have 

Outside 
Own 
Country 


Read far 
Every Day 


Never or 

Read for 
Fun 


Populations 












Canada 


63 


% 


79 


38(67)** 


16(60)** 


Alberta 


65 


98 


76 


39(67) 


18(61) 


British Columbia 


67 


97 


86 


39(70) 


17(61) 


Manitoba - Engl. 


63 


96 


82 


36(66) 


21(58) 


Manitoba - French 


61 


96 


87 


43(64) 


12(55) 


N. Bruns. - Engl. 


57 


94 


77 


37(60) 


22(52) 


N. Bruns. - French 


55 


94 


55 


29(60) 


19(50) 


Newfoundland 


57 


93 


42 


38(59) 


18(53) 


Ontario - English 


62 


97 


86 


39(66) 


16(57) 


1 Ontario - French 


52 


96 


67 


34(57) 


16(47) 


fl Quebec - English 


67 


96 


88 


38(69) 


14(63) 


Quebec - French 


64 


92 


61 


32(68) 


14(59) 


Sask. - English 


63 


98 


69 


38(67) 


19(59) 


Sask. - French 


61 


98 


82 


45(63) 


11(55) 


Other Participating 
Countries 




Hungary 


70 


N/A 


N/A 


44(75) 


3(64) 


Ireland 


59 


89 


N/A 


41(63) 


16(52) 


Korea 


60 


71 


3 


11(68) 


13(53) 


Scotland 


58 


94 


68 


38(62) 


16(51) 


Slovenia 


65 


85 


81 


42(67) 


8(59) 


Soviet Union 


63 


N/A 


N/A 


47(66) 


10(56) 


Spain 


60 


89 


38 


35(63) 


13(57) 


United States 


62 


95 


39 


29(66) 


21(59) 



* Student Questionnaire N/A Information is not available 

** Average Percent Correct ( ). 
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Observations (Figure S.3) 



There are many interesting bits of information that need more research. For example, a relatively 
high percentage of students report travel outside their home coimtry. Does traveling abroad 
support in^ioved learning and higher performance? More research is needed 

In every population, students who report reading for fun every day consistently achieve a higher 
average percent correct than do students who read less often or not at all. This consistent, positive 
relationship between reading and achievement is also evident in mathematics and science. 
Hungary, the highest performing country in the study, reports only 3% of students that never or 
almost never read for fun. Korea reports a relatively low percentage of students that read for fun 
on a daily basis, but daily readers score on average 15 percentage points higher than students who 
never or almost never read These figures support the positive impact of reading on performance. 
As in mathematics and science, other factors must contribute to the explanation of the higher 
performances of Korean students. 



FINAL WORD 

lAEP n has provided a great amount of data that lead us to reflect on possible reasons why 
students in some countries do better than students in others. A number of variables examined in 
the study were associated vr^h. differences in curriculum, study conditions, cultural and family 
values. While very few were found to be clearly related to student performance, there are hints 
about the importance of some, such as instructional time and the prevalence of lx>oks in the home. 

While there is a need for caution in interpreting results such as these, because of the significant 
variations among countries, this international perspective is very important in our reflections on 
how well our students are doing in various areas. The trends observed here can help us, at least in 
part, to understand better the learning environment in Alberta. 
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APPENDIX 1: Overall Summary of Test Administration by Country and 
Canadian Province for Age 9 and Age 13* 





Scheduled 
Assessment 
Month 


Who Gave Test 


Test 
Aaministrator 
Training 


Practice 
lest Used 


Percent of 
d 1 tes 
Visited 


Percent of 
Accurate 
Scores** 


Brazil 


Sepl '90 


External 
Administrators 


Yes 


No 


23 


99.5 


Canada 
Alberta 


March '91 


School Personnel 


No 


No 


20 


99.7 


British Columbia 


March '91 


School Personnel 


No 


No 


Informal 


99.5 


Manitoba 


March '91 


School Personnel 


Yes 


No 


18 


99,6 


N. Brunswick-EngL 


March '91 


School Personnel 


Yes 


Optional 


15 


99.8 


N. Bnmswick-Fr. 


March '91 


School Personnel 


Yes 


Yes 


39 


_ 


Newfoundland 


March '91 


School Personnel 


No 


No 


21 


99.0 


Nova Scotia 


March '91 


School Personnel 


No 


No 


21 


99.9 


Ontario 


March '91 


School Personnel 


Yes 


Yes (9) 
Optional (13) 


19 


98.1 


Quebec 


March '91 


School Personnel 


Yes 


Yes 


22 


98.2 


Saskatchewan 


March '91 


School Personnel 


No 


No 


Informal 


99.3 


China 


March '91 


School Personnel 


Yes 


No 


19 


99.6 


England 


March '91 


School Personnel 


No 


No 


Informal 


99.4 


France 


March '91 


School Personnel 


Yes 


Yes 


21 


99.5 


Hungary 


March '91 


School Personnel 


Yes 


No 


16 


99.6 


Ireland 


March *91 


School Personnel 


No 


No 


Informal 


99.4 


Israel 


March '91 


School Personnel 


Yes 


No 


19 


99.5 


Italy 


March '91 


School Personnel 


Yes 


No 


21 


99.6 


Jordan 


March '91 


School Personnel 


Yes 


Yes 


24 


100.0 


Korea 


Sept '90 


School Personnel 


Yes 


Yes 


20 


98.0 


Mozambique 


Sept '90 


Administrators 


Yes 


No 


Informal 


99.3 


Portugal 


March *91 


JCf Aid ll4U 

Administrators 


Yes 


Yes (9) 
No (13) 


20 


99.5 


Scotland 


March '91 


School Personnel 


No 


Optional (9) 
No (13) 


Informal 


Not Done 


Slovenia 


March '91 


External 
Administrators 


Yes 


Optional 


10 


99.8 


Soviet Union 


March '91 (9) 
April '91 (13) 


School Personnel 


Yes 


Yes 


52 


99.3 


Spain 


March '91 


External 
Administrators 


Yes 


Optional (9) 
No (13) 


20 


99.7 


Switzerland 


March '91 


School Personnel 


Yes 


No 


Informal 




Taiwan 


March '91 


School Personnel 


Yes 


No 


20 


99.8 


United Stales 


March '91 


School Personnel 


No 


No 


16 


99.8 



* Complete results for all countries can be found in the Learning Mathematics and Learning Science reports. 

** This number rei>rcsenis the mean of the percent of accurate scores by scorers for constmcted-response questions. 
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APPENDIX 2: Quality Control Procedures 



Translations of Assessment Materials Independently Verified 

Achievement and background questions and pupil directions were adapted and translated within each country and then checked 
independently by language experts in the United States. All couintries used the same artwork and physical layouts for their tests. 



Pilot Test of Assessment Questions 

Achievement and background questions were pilot-tested with groups of pupils from each participating country (except Slovenia, which 
joined the project late) to determine which questions would work best in the final assessment 



Samples Independently Verified 

Samples for each population were drawn using agreed-upon procedures and were independently checked in the United States to ensure thai 
procedures were followed accurately and that sampling weights were appropriately calculated. 



Procedural Manuals and Training Provided 

Procedural manuals were developed for coordinating the project, drawing samples, administering the assessments, conducting a quality 
control program, and entering results into a database. Regional training sessions were held at which the individuals from each assessment 
centre who actually performed the tasks were provided detailed instructions and hands-on experience. 



Computer Software Provided 

Specially developed computer software was provided to the participants to facilitate sampling and data entry and to ensure uiniformity and 
quality. 



Standardized Test Administration 

Test booklets were administered to students using the same instructions and the same time limits in each participating country. To ensure 
procedures were understood, test administrators, usually school personnel, were trained in 20 out of 29 assessment centres. 



On-site Observation of Assessments 
Unannounced observations of the test administrations were conducted by all assessment centres. 



Independent Quality Control 

In all countries except Brazil and Mozambique, an independent, trained observer interviewed the country project manager about all aspects 
of the project and visited one or more test administration sites. In most cases, the observer was fluent in the language of the assessment. 



Data Files and Data Analysis Validated 

The scoring of open-ended mathematics questions was checked in 10 percent of the booklets by 27 out of 29 assessment centres and in all 
cases, accuracy of scoring was 98 percent or higher. Each couintry validated its own data files, using software provided by the project, to 
ascertain their quality and accuracy. Data files were also independently validated by comparing the responses of a random set of 10 student 
booklets and 10 school questionnaires of each type to the data entered into the databases. If data files contained 1 percent errors or 
greater, participants were asked to rekey aU the responses. This happened in one case. Data analysis procedures were checked by 
calculating statistics using different programs and computer equipment and comparing the results. 



Assessment Questions Checlced for Curricular or Cultural Bias 

Assessment results were checked to verify that responses to individual questions could be summarized without misrepresenting curricular 
or cultural differences within particular countries. Cluster analyses and analyses of differential item functioning (DIF) resulted in the 
removal of one mathematics questions at each age level, two science questions at age 9, and eight at age 13 before final analyses were 
conducted. 




